2025-04-03 22:58:02,527 [ 355350 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2025-04-03 22:58:02,527 [ 355350 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:97, check_args_and_update_paths) 2025-04-03 22:58:02,527 [ 355350 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:108, check_args_and_update_paths) 2025-04-03 22:58:02,527 [ 355350 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:110, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_fv83un --privileged --dns-search='.' --memory=30709035008 --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=6712d5cc610d -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact]' 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1]' test_polymorphic_parts/test.py::test_polymorphic_parts_index test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive test_prometheus_endpoint/test.py::test_prometheus_endpoint test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_ttl test_quorum_inserts/test.py::test_simple_add_replica test_read_temporary_tables_on_failure/test.py::test_different_versions test_recovery_time_metric/test.py::test_recovery_time_metric test_redirect_url_storage/test.py::test_predefined_connection_configuration test_redirect_url_storage/test.py::test_url_with_globs test_redirect_url_storage/test.py::test_url_with_globs_and_failover test_redirect_url_storage/test.py::test_url_with_redirect_allowed test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed test_redirect_url_storage/test.py::test_url_without_redirect test_regexp_logger/test.py::test_regexp_pattern_update test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_zookeeper/test.py::test_reload_zookeeper 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replica_can_become_leader/test.py::test_can_become_leader test_replicated_database/test.py::test_all_groups_cluster 'test_replicated_database/test.py::test_alter_attach[MergeTree]' 'test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[MergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree]' test_replicated_database/test.py::test_alter_fetch test_replicated_database/test.py::test_alters_from_different_replicas test_replicated_database/test.py::test_auto_recovery test_replicated_database/test.py::test_create_replicated_table 'test_replicated_database/test.py::test_delete_from_table[MergeTree]' 'test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_detach_attach_table test_replicated_database/test.py::test_flatten_nested test_replicated_database/test.py::test_force_synchronous_settings test_replicated_database/test.py::test_modify_comment test_replicated_database/test.py::test_recover_digest_mismatch test_replicated_database/test.py::test_replicated_table_structure_alter test_replicated_database/test.py::test_server_uuid 'test_replicated_database/test.py::test_simple_alter_table[MergeTree]' 'test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_table_metadata_corruption test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable 'test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header]' test_s3_assume_role/test.py::test_using_assumed_creds test_s3_cluster/test.py::test_ambiguous_join test_s3_cluster/test.py::test_cluster_default_expression test_s3_cluster/test.py::test_cluster_format_detection test_s3_cluster/test.py::test_cluster_with_header test_s3_cluster/test.py::test_cluster_with_named_collection test_s3_cluster/test.py::test_count test_s3_cluster/test.py::test_count_macro test_s3_cluster/test.py::test_distributed_insert_select_with_replicated test_s3_cluster/test.py::test_distributed_s3_table_engine test_s3_cluster/test.py::test_hive_partitioning test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference test_s3_cluster/test.py::test_remote_hedged test_s3_cluster/test.py::test_remote_no_hedged test_s3_cluster/test.py::test_select_all test_s3_cluster/test.py::test_skip_unavailable_shards test_s3_cluster/test.py::test_union_all test_s3_cluster/test.py::test_unset_skip_unavailable_shards test_s3_cluster/test.py::test_wrong_cluster test_send_crash_reports/test.py::test_send_segfault 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6]' test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session -vvv" altinityinfra/integration-tests-runner:cd6390247eca '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: random-0.2, timeout-2.2.0, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1] test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header] test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] test_s3_cluster/test.py::test_ambiguous_join test_reload_client_certificate/test.py::test_correct_cn_cert test_redirect_url_storage/test.py::test_predefined_connection_configuration test_replicated_database/test.py::test_all_groups_cluster [gw8] [ 1%] PASSED test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header] test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header] [gw9] [ 2%] PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 [gw6] [ 3%] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1] test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2] [gw8] [ 4%] PASSED test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header] test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header] [gw0] [ 5%] PASSED test_replicated_database/test.py::test_all_groups_cluster test_replicated_database/test.py::test_alter_attach[MergeTree] [gw8] [ 6%] PASSED test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header] [gw6] [ 7%] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2] test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3] [gw5] [ 8%] PASSED test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] [gw0] [ 9%] PASSED test_replicated_database/test.py::test_alter_attach[MergeTree] test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree] [gw1] [ 10%] PASSED test_s3_cluster/test.py::test_ambiguous_join test_s3_cluster/test.py::test_cluster_default_expression [gw3] [ 11%] PASSED test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False] [gw6] [ 12%] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3] test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4] [gw9] [ 13%] PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 [gw5] [ 14%] PASSED test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] [gw0] [ 15%] PASSED test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree] test_replicated_database/test.py::test_alter_detach_part[MergeTree] test_prometheus_endpoint/test.py::test_prometheus_endpoint [gw3] [ 16%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False] test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True] [gw6] [ 17%] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4] test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5] [gw1] [ 18%] PASSED test_s3_cluster/test.py::test_cluster_default_expression test_s3_cluster/test.py::test_cluster_format_detection [gw0] [ 19%] PASSED test_replicated_database/test.py::test_alter_detach_part[MergeTree] test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree] [gw3] [ 20%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True] test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection [gw6] [ 21%] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5] test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6] [gw0] [ 22%] PASSED test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree] test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree] [gw1] [ 23%] PASSED test_s3_cluster/test.py::test_cluster_format_detection test_s3_cluster/test.py::test_cluster_with_header [gw0] [ 24%] PASSED test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree] test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree] [gw6] [ 25%] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6] [gw1] [ 26%] PASSED test_s3_cluster/test.py::test_cluster_with_header test_s3_cluster/test.py::test_cluster_with_named_collection [gw1] [ 27%] PASSED test_s3_cluster/test.py::test_cluster_with_named_collection test_s3_cluster/test.py::test_count [gw0] [ 28%] PASSED test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree] test_replicated_database/test.py::test_alter_drop_part[MergeTree] [gw1] [ 29%] PASSED test_s3_cluster/test.py::test_count test_s3_cluster/test.py::test_count_macro test_read_temporary_tables_on_failure/test.py::test_different_versions [gw9] [ 30%] PASSED test_prometheus_endpoint/test.py::test_prometheus_endpoint [gw1] [ 31%] PASSED test_s3_cluster/test.py::test_count_macro test_s3_cluster/test.py::test_distributed_insert_select_with_replicated [gw2] [ 32%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] [gw2] [ 33%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format [gw0] [ 34%] PASSED test_replicated_database/test.py::test_alter_drop_part[MergeTree] test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree] test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop [gw0] [ 35%] PASSED test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree] test_replicated_database/test.py::test_alter_drop_partition[MergeTree] [gw2] [ 36%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] [gw2] [ 37%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] test_recovery_time_metric/test.py::test_recovery_time_metric [gw1] [ 38%] PASSED test_s3_cluster/test.py::test_distributed_insert_select_with_replicated test_s3_cluster/test.py::test_distributed_s3_table_engine [gw7] [ 39%] PASSED test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert [gw0] [ 40%] PASSED test_replicated_database/test.py::test_alter_drop_partition[MergeTree] test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree] [gw2] [ 41%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] [gw1] [ 42%] PASSED test_s3_cluster/test.py::test_distributed_s3_table_engine test_s3_cluster/test.py::test_hive_partitioning [gw3] [ 43%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False] [gw0] [ 44%] PASSED test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree] test_replicated_database/test.py::test_alter_fetch [gw2] [ 45%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] [gw0] [ 46%] PASSED test_replicated_database/test.py::test_alter_fetch test_replicated_database/test.py::test_alters_from_different_replicas [gw3] [ 47%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False] test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True] [gw1] [ 48%] PASSED test_s3_cluster/test.py::test_hive_partitioning test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference [gw5] [ 49%] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] [gw1] [ 50%] PASSED test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference test_s3_cluster/test.py::test_remote_hedged [gw2] [ 51%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] [gw1] [ 52%] PASSED test_s3_cluster/test.py::test_remote_hedged test_s3_cluster/test.py::test_remote_no_hedged [gw1] [ 53%] PASSED test_s3_cluster/test.py::test_remote_no_hedged test_s3_cluster/test.py::test_select_all [gw8] [ 54%] PASSED test_read_temporary_tables_on_failure/test.py::test_different_versions [gw1] [ 55%] PASSED test_s3_cluster/test.py::test_select_all test_s3_cluster/test.py::test_skip_unavailable_shards [gw3] [ 56%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True] test_quorum_inserts/test.py::test_insert_quorum_with_ttl [gw1] [ 57%] PASSED test_s3_cluster/test.py::test_skip_unavailable_shards test_s3_cluster/test.py::test_union_all [gw6] [ 58%] PASSED test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop [gw1] [ 59%] PASSED test_s3_cluster/test.py::test_union_all test_s3_cluster/test.py::test_unset_skip_unavailable_shards [gw1] [ 60%] PASSED test_s3_cluster/test.py::test_unset_skip_unavailable_shards test_s3_cluster/test.py::test_wrong_cluster [gw1] [ 61%] PASSED test_s3_cluster/test.py::test_wrong_cluster [gw2] [ 62%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_regexp_logger/test.py::test_regexp_pattern_update [gw4] [ 63%] PASSED test_redirect_url_storage/test.py::test_predefined_connection_configuration test_redirect_url_storage/test.py::test_url_with_globs test_reload_zookeeper/test.py::test_reload_zookeeper [gw2] [ 64%] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format [gw4] [ 65%] PASSED test_redirect_url_storage/test.py::test_url_with_globs test_redirect_url_storage/test.py::test_url_with_globs_and_failover [gw4] [ 66%] PASSED test_redirect_url_storage/test.py::test_url_with_globs_and_failover test_redirect_url_storage/test.py::test_url_with_redirect_allowed [gw9] [ 67%] PASSED test_recovery_time_metric/test.py::test_recovery_time_metric [gw4] [ 68%] PASSED test_redirect_url_storage/test.py::test_url_with_redirect_allowed test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed [gw4] [ 69%] PASSED test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed test_redirect_url_storage/test.py::test_url_without_redirect [gw4] [ 70%] PASSED test_redirect_url_storage/test.py::test_url_without_redirect test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers [gw3] [ 71%] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_ttl test_quorum_inserts/test.py::test_simple_add_replica [gw3] [ 72%] PASSED test_quorum_inserts/test.py::test_simple_add_replica [gw8] [ 73%] PASSED test_regexp_logger/test.py::test_regexp_pattern_update [gw5] [ 74%] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] test_polymorphic_parts/test.py::test_polymorphic_parts_index [gw5] [ 75%] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_index test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive test_send_crash_reports/test.py::test_send_segfault test_replica_can_become_leader/test.py::test_can_become_leader [gw5] [ 76%] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive [gw9] [ 77%] PASSED test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers [gw0] [ 78%] PASSED test_replicated_database/test.py::test_alters_from_different_replicas test_replicated_database/test.py::test_auto_recovery [gw2] [ 79%] SKIPPED test_send_crash_reports/test.py::test_send_segfault test_s3_assume_role/test.py::test_using_assumed_creds [gw8] [ 80%] PASSED test_replica_can_become_leader/test.py::test_can_become_leader [gw6] [ 81%] PASSED test_reload_zookeeper/test.py::test_reload_zookeeper [gw0] [ 82%] PASSED test_replicated_database/test.py::test_auto_recovery test_replicated_database/test.py::test_create_replicated_table [gw9] [ 83%] FAILED test_s3_assume_role/test.py::test_using_assumed_creds [gw0] [ 84%] PASSED test_replicated_database/test.py::test_create_replicated_table test_replicated_database/test.py::test_delete_from_table[MergeTree] test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable [gw0] [ 85%] PASSED test_replicated_database/test.py::test_delete_from_table[MergeTree] test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree] [gw0] [ 86%] PASSED test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree] test_replicated_database/test.py::test_detach_attach_table [gw0] [ 87%] PASSED test_replicated_database/test.py::test_detach_attach_table test_replicated_database/test.py::test_flatten_nested [gw0] [ 88%] PASSED test_replicated_database/test.py::test_flatten_nested test_replicated_database/test.py::test_force_synchronous_settings [gw6] [ 89%] PASSED test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable [gw0] [ 90%] PASSED test_replicated_database/test.py::test_force_synchronous_settings test_replicated_database/test.py::test_modify_comment [gw0] [ 91%] PASSED test_replicated_database/test.py::test_modify_comment test_replicated_database/test.py::test_recover_digest_mismatch [gw7] [ 92%] PASSED test_reload_client_certificate/test.py::test_wrong_cn_cert test_session_log/test.py::test_grpc_session [gw0] [ 93%] PASSED test_replicated_database/test.py::test_recover_digest_mismatch test_replicated_database/test.py::test_replicated_table_structure_alter [gw7] [ 94%] PASSED test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session [gw0] [ 95%] PASSED test_replicated_database/test.py::test_replicated_table_structure_alter test_replicated_database/test.py::test_server_uuid [gw7] [ 96%] PASSED test_session_log/test.py::test_mysql_session [gw0] [ 97%] PASSED test_replicated_database/test.py::test_server_uuid test_replicated_database/test.py::test_simple_alter_table[MergeTree] [gw0] [ 98%] PASSED test_replicated_database/test.py::test_simple_alter_table[MergeTree] test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree] [gw0] [ 99%] PASSED test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree] test_replicated_database/test.py::test_table_metadata_corruption [gw0] [100%] PASSED test_replicated_database/test.py::test_table_metadata_corruption =================================== FAILURES =================================== ___________________________ test_using_assumed_creds ___________________________ [gw9] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_using_assumed_creds(started_cluster): instance = started_cluster.instances["node1"] # Create some file in non public-accessible minio > instance.query( """ INSERT INTO FUNCTION s3 ( 'http://minio1:9001/root/test_assume.csv', 'minio', 'ClickHouse_Minio_P@ssw0rd', 'CSVWithNames' ) SELECT number as num, toString(number) as strnum FROM numbers(5); """ ) test_s3_assume_role/test.py:46: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3678: in query return self.client.query( helpers/client.py:39: in wrap return func(self, *args, **kwargs) helpers/client.py:79: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 243, stderr: Received exception from server (version 24.12.2): E Code: 499. DB::Exception: Received from 172.16.2.6:9000. DB::Exception: Failed to check existence of key test_assume.csv in bucket root: No response body.. Stack trace: E E 0. ./contrib/llvm-project/libcxx/include/exception:141: Poco::Exception::Exception(String const&, int) @ 0x0000000038051b14 E 1. ./build_docker/./src/Common/Exception.cpp:105: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000001bc29d05 E 2. DB::Exception::Exception(PreformattedMessage&&, int) @ 0x000000000b2ac545 E 3. ./src/IO/S3Common.h:36: DB::S3Exception::S3Exception(Aws::S3::S3Errors, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String const&, String const&, String const&) @ 0x0000000028c39f81 E 4. ./build_docker/./src/IO/S3/getObjectInfo.cpp:120: DB::S3::objectExists(DB::S3::Client const&, String const&, String const&, String const&) @ 0x0000000028c3916b E 5. ./build_docker/./src/Disks/ObjectStorages/S3/S3ObjectStorage.cpp:164: DB::S3ObjectStorage::exists(DB::StoredObject const&) const @ 0x0000000028c19ffe E 6. ./build_docker/./src/Storages/ObjectStorage/Utils.cpp:21: DB::checkAndGetNewFileOnInsertIfNeeded(DB::IObjectStorage const&, DB::StorageObjectStorage::Configuration const&, DB::StorageObjectStorage::QuerySettings const&, String const&, unsigned long) @ 0x0000000028a9242b E 7. ./build_docker/./src/Storages/ObjectStorage/StorageObjectStorage.cpp:402: DB::StorageObjectStorage::write(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, bool) @ 0x000000002892ff92 E 8. ./build_docker/./src/Processors/Transforms/buildPushingToViewsChain.cpp:620: DB::buildPushingToViewsChain(std::shared_ptr const&, std::shared_ptr const&, std::shared_ptr, std::shared_ptr const&, unsigned long, bool, std::shared_ptr, std::shared_ptr, std::atomic*, bool, DB::Block const&) @ 0x00000000314b4c2e E 9. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:365: DB::InterpreterInsertQuery::buildSink(std::shared_ptr const&, unsigned long, std::shared_ptr const&, std::shared_ptr, std::shared_ptr, std::atomic*) @ 0x000000002c176211 E 10. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:451: DB::InterpreterInsertQuery::buildPreAndSinkChains(unsigned long, unsigned long, std::shared_ptr, unsigned long, std::shared_ptr const&, DB::Block const&) @ 0x000000002c177f49 E 11. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:649: DB::InterpreterInsertQuery::buildInsertSelectPipeline(DB::ASTInsertQuery&, std::shared_ptr) @ 0x000000002c17b91d E 12. ./build_docker/./src/Interpreters/InterpreterInsertQuery.cpp:818: DB::InterpreterInsertQuery::execute() @ 0x000000002c18152a E 13. ./build_docker/./src/Interpreters/executeQuery.cpp:1368: DB::executeQueryImpl(char const*, char const*, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x000000002c9a2645 E 14. ./build_docker/./src/Interpreters/executeQuery.cpp:1535: DB::executeQuery(String const&, std::shared_ptr, DB::QueryFlags, DB::QueryProcessingStage::Enum) @ 0x000000002c99b024 E 15. ./build_docker/./src/Server/TCPHandler.cpp:656: DB::TCPHandler::runImpl() @ 0x0000000030a9468c E 16. ./build_docker/./src/Server/TCPHandler.cpp:2603: DB::TCPHandler::run() @ 0x0000000030ac4d94 E 17. ./build_docker/./base/poco/Net/src/TCPServerConnection.cpp:40: Poco::Net::TCPServerConnection::start() @ 0x000000003822ddcf E 18. ./build_docker/./base/poco/Net/src/TCPServerDispatcher.cpp:115: Poco::Net::TCPServerDispatcher::run() @ 0x000000003822e97e E 19. ./build_docker/./base/poco/Foundation/src/ThreadPool.cpp:205: Poco::PooledThread::run() @ 0x0000000038130ccb E 20. ./base/poco/Foundation/src/Thread_POSIX.cpp:335: Poco::ThreadImpl::runnableEntry(void*) @ 0x000000003812ae68 E 21. asan_thread_start(void*) @ 0x000000000b25be77 E 22. ? @ 0x00007ff5c75efac3 E 23. ? @ 0x00007ff5c7681850 E . (S3_ERROR) E (query: INSERT INTO FUNCTION s3 E ( E 'http://minio1:9001/root/test_assume.csv', 'minio', 'ClickHouse_Minio_P@ssw0rd', 'CSVWithNames' E ) E SELECT number as num, toString(number) as strnum FROM numbers(5);) helpers/client.py:248: QueryRuntimeException ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 ENV HOSTNAME 479ad35ad9f8 ENV SHLVL 0 ENV HOME /root ENV OLDPWD / ENV DOCKER_HELPER_TAG 5dc43a6382f0 ENV PYTHONUNBUFFERED 1 ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e ENV UBSAN_OPTIONS print_stacktrace=1 ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact]' 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1]' test_polymorphic_parts/test.py::test_polymorphic_parts_index test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive test_prometheus_endpoint/test.py::test_prometheus_endpoint test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_ttl test_quorum_inserts/test.py::test_simple_add_replica test_read_temporary_tables_on_failure/test.py::test_different_versions test_recovery_time_metric/test.py::test_recovery_time_metric test_redirect_url_storage/test.py::test_predefined_connection_configuration test_redirect_url_storage/test.py::test_url_with_globs test_redirect_url_storage/test.py::test_url_with_globs_and_failover test_redirect_url_storage/test.py::test_url_with_redirect_allowed test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed test_redirect_url_storage/test.py::test_url_without_redirect test_regexp_logger/test.py::test_regexp_pattern_update test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_zookeeper/test.py::test_reload_zookeeper 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replica_can_become_leader/test.py::test_can_become_leader test_replicated_database/test.py::test_all_groups_cluster 'test_replicated_database/test.py::test_alter_attach[MergeTree]' 'test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[MergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree]' test_replicated_database/test.py::test_alter_fetch test_replicated_database/test.py::test_alters_from_different_replicas test_replicated_database/test.py::test_auto_recovery test_replicated_database/test.py::test_create_replicated_table 'test_replicated_database/test.py::test_delete_from_table[MergeTree]' 'test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_detach_attach_table test_replicated_database/test.py::test_flatten_nested test_replicated_database/test.py::test_force_synchronous_settings test_replicated_database/test.py::test_modify_comment test_replicated_database/test.py::test_recover_digest_mismatch test_replicated_database/test.py::test_replicated_table_structure_alter test_replicated_database/test.py::test_server_uuid 'test_replicated_database/test.py::test_simple_alter_table[MergeTree]' 'test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_table_metadata_corruption test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable 'test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header]' test_s3_assume_role/test.py::test_using_assumed_creds test_s3_cluster/test.py::test_ambiguous_join test_s3_cluster/test.py::test_cluster_default_expression test_s3_cluster/test.py::test_cluster_format_detection test_s3_cluster/test.py::test_cluster_with_header test_s3_cluster/test.py::test_cluster_with_named_collection test_s3_cluster/test.py::test_count test_s3_cluster/test.py::test_count_macro test_s3_cluster/test.py::test_distributed_insert_select_with_replicated test_s3_cluster/test.py::test_distributed_s3_table_engine test_s3_cluster/test.py::test_hive_partitioning test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference test_s3_cluster/test.py::test_remote_hedged test_s3_cluster/test.py::test_remote_no_hedged test_s3_cluster/test.py::test_select_all test_s3_cluster/test.py::test_skip_unavailable_shards test_s3_cluster/test.py::test_union_all test_s3_cluster/test.py::test_unset_skip_unavailable_shards test_s3_cluster/test.py::test_wrong_cluster test_send_crash_reports/test.py::test_send_segfault 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6]' test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session -vvv ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge ENV COMPOSE_HTTP_TIMEOUT 600 ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 ENV CLICKHOUSE_USE_OLD_ANALYZER 1 ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV DOCKER_KERBERIZED_HADOOP_TAG latest ENV DOCKER_CHANNEL stable ENV DOCKER_CLIENT_TIMEOUT 300 ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e ENV PWD /ClickHouse/tests/integration ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config ENV TZ Etc/UTC ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java ENV DOCKER_BASE_TAG 6712d5cc610d ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 ENV LC_CTYPE C.UTF-8 ENV INTEGRATION_TESTS_RUN_ID 0 ENV WORKER_FREE_PORTS 30450 30451 30452 30453 30454 30455 30456 30457 30458 30459 30460 30461 30462 30463 30464 30465 30466 30467 30468 30469 30470 30471 30472 30473 30474 30475 30476 30477 30478 30479 30480 30481 30482 30483 30484 30485 30486 30487 30488 30489 30490 30491 30492 30493 30494 30495 30496 30497 30498 30499 ENV PYTEST_XDIST_TESTRUNUID bb012ce1fe4a4fa6b434dc1157876ebd ENV PYTEST_XDIST_WORKER gw9 ENV PYTEST_XDIST_WORKER_COUNT 10 ENV PYTEST_CURRENT_TEST test_s3_assume_role/test.py::test_using_assumed_creds (setup) CLUSTER INIT base_config_dir:/clickhouse-config clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log Cluster name: project_name:roottests3assumerole-gw9. Added instance name:node1 tag:6712d5cc610d base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env', '--project-name', 'roottests3assumerole-gw9', '--file', '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ Starting cluster... Running tests in /ClickHouse/tests/integration/test_s3_assume_role/test.py Cluster start called. is_up=False Docker networks for project roottests3assumerole-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3assumerole-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3assumerole-gw9 are DRIVER VOLUME NAME Cleanup called Docker networks for project roottests3assumerole-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3assumerole-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3assumerole-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3assumerole-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} No running containers for project: roottests3assumerole-gw9 Trying to prune unused networks... Trying to prune unused images... Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Images pruned Trying to prune unused volumes... Command:[docker volume ls | wc -l] Stdout:4 Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Volumes pruned: 4 Setup directory for instance: node1 Create directory for configuration generated in this helper Create directory for common tests configuration Copy common configuration from helpers Generate and write macros file Copy custom test config files [] to /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/configs/config.d Setup database dir /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/database Setup logs dir /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/logs Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] No config file found http://localhost:None "GET /version HTTP/1.1" 200 826 Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env --project-name roottests3assumerole-gw9 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] Stderr: proxy2 Skipped - Image is already being pulled by proxy1 Stderr: node1 Pulling Stderr: minio1 Pulling Stderr: proxy1 Pulling Stderr: resolver Pulling Stderr: resolver Pulled Stderr: minio1 Pulled Stderr: proxy1 Pulled Stderr: node1 Pulled Trying to create Minio instance by command docker compose --project-name roottests3assumerole-gw9 --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d Command:[docker compose --project-name roottests3assumerole-gw9 --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] Stderr:time="2025-04-03T23:00:16Z" level=trace msg="Docker Desktop integration not enabled" Stderr: Network roottests3assumerole-gw9_default Creating Stderr: Network roottests3assumerole-gw9_default Created Stderr: Volume "roottests3assumerole-gw9_data1-1" Creating Stderr: Volume "roottests3assumerole-gw9_data1-1" Created Stderr: Container roottests3assumerole-gw9-proxy1-1 Creating Stderr: Container roottests3assumerole-gw9-proxy2-1 Creating Stderr: proxy2 The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64/v3) and no specific platform was requested Stderr: Container roottests3assumerole-gw9-proxy2-1 Created Stderr: proxy1 The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64/v3) and no specific platform was requested Stderr: Container roottests3assumerole-gw9-proxy1-1 Created Stderr: Container roottests3assumerole-gw9-minio1-1 Creating Stderr: Container roottests3assumerole-gw9-resolver-1 Creating Stderr: Container roottests3assumerole-gw9-resolver-1 Created Stderr: Container roottests3assumerole-gw9-minio1-1 Created Stderr: Container roottests3assumerole-gw9-proxy2-1 Starting Stderr: Container roottests3assumerole-gw9-proxy1-1 Starting Stderr: Container roottests3assumerole-gw9-proxy2-1 Started Stderr: Container roottests3assumerole-gw9-proxy1-1 Started Stderr: Container roottests3assumerole-gw9-minio1-1 Starting Stderr: Container roottests3assumerole-gw9-resolver-1 Starting Stderr: Container roottests3assumerole-gw9-minio1-1 Started Stderr: Container roottests3assumerole-gw9-resolver-1 Started Stderr:time="2025-04-03T23:00:17Z" level=debug msg="otel error" error="" Stderr:time="2025-04-03T23:00:17Z" level=debug msg="otel error" error="" Trying to connect to Minio... get_instance_ip instance_name=minio1 http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw9-minio1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=proxy1 http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw9-proxy1-1/json HTTP/1.1" 200 None Starting new HTTP connection (1): 172.16.2.5:9001 Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (2): 172.16.2.5:9001 Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (3): 172.16.2.5:9001 Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / Starting new HTTP connection (4): 172.16.2.5:9001 Can't connect to Minio: HTTPConnectionPool(host='172.16.2.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) Starting new HTTP connection (5): 172.16.2.5:9001 http://172.16.2.5:9001 "GET / HTTP/1.1" 200 0 Connected to Minio. http://172.16.2.5:9001 "GET /root?location= HTTP/1.1" 404 0 http://172.16.2.5:9001 "PUT /root HTTP/1.1" 200 0 S3 bucket 'root' created http://172.16.2.5:9001 "GET /root2?location= HTTP/1.1" 404 0 http://172.16.2.5:9001 "PUT /root2 HTTP/1.1" 200 0 S3 bucket 'root2' created ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env --project-name roottests3assumerole-gw9 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env --project-name roottests3assumerole-gw9 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] Stderr: Container roottests3assumerole-gw9-proxy2-1 Running Stderr: Container roottests3assumerole-gw9-proxy1-1 Running Stderr: Container roottests3assumerole-gw9-resolver-1 Running Stderr: Container roottests3assumerole-gw9-minio1-1 Running Stderr: Container roottests3assumerole-gw9-node1-1 Creating Stderr: Container roottests3assumerole-gw9-node1-1 Created Stderr: Container roottests3assumerole-gw9-node1-1 Starting Stderr: Container roottests3assumerole-gw9-node1-1 Started ClickHouse instance created get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw9-node1-1/json HTTP/1.1" 200 None get_instance_ip instance_name=node1 http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw9-node1-1/json HTTP/1.1" 200 None Waiting for ClickHouse start in node1, ip: 172.16.2.6... http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw9-node1-1/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None ClickHouse node1 started Starting mock server mock_sts.py run container_id:roottests3assumerole-gw9-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo aW1wb3J0IHN5cwoKZnJvbSBib3R0bGUgaW1wb3J0IHJlc3BvbnNlLCByb3V0ZSwgcnVuCgoKTU9DS19YTUxfUkVTUE9OU0UgPSAiIiI8QXNzdW1lUm9sZVJlc3BvbnNlIHhtbG5zPSJodHRwczovL3N0cy5hbWF6b25hd3MuY29tL2RvYy8yMDExLTA2LTE1LyI+CiAgPEFzc3VtZVJvbGVSZXN1bHQ+CiAgICA8Q3JlZGVudGlhbHM+CiAgICAgIDxBY2Nlc3NLZXlJZD5taW5pbzwvQWNjZXNzS2V5SWQ+CiAgICAgIDxTZWNyZXRBY2Nlc3NLZXk+Q2xpY2tIb3VzZV9NaW5pb19QQHNzdzByZDwvU2VjcmV0QWNjZXNzS2V5PgogICAgICA8RXhwaXJhdGlvbj4yMDU1LTEyLTMxVDIzOjU5OjU5WjwvRXhwaXJhdGlvbj4KICAgIDwvQ3JlZGVudGlhbHM+CiAgPC9Bc3N1bWVSb2xlUmVzdWx0Pgo8L0Fzc3VtZVJvbGVSZXNwb25zZT4iIiIKCiMgPFNlc3Npb25Ub2tlbj5NT0NLX1NFU1NJT05fVE9LRU48L1Nlc3Npb25Ub2tlbj4gIGlzIG5vdCBiZWluZyByZXR1cm5lZCAtLSBpdCBpcyBub3QgcmVxdWlyZWQgYnkgbWluaW8KIyBXaGVuICJyZWFsIiBTVFMgcmV0dXJucyBpdCAtLSBpdCBpcyBhbHNvIHVzZWQgdG8gcmVhZCBmcm9tIHMzCgpAcm91dGUoIi8iLCBtZXRob2Q9IlBPU1QiKQpkZWYgcmV0dXJuX2NyZWRzKCk6CiAgICByZXNwb25zZS5zdGF0dXMgPSAyMDAKICAgIHJlc3BvbnNlLmNvbnRlbnRfdHlwZSA9ICJhcHBsaWNhdGlvbi94bWwiCiAgICByZXR1cm4gTU9DS19YTUxfUkVTUE9OU0UKCgpAcm91dGUoIi8iLCBtZXRob2Q9IkdFVCIpCmRlZiBwaW5nKCk6CiAgICByZXR1cm4gIk9LIgoKCnJ1bihob3N0PSIwLjAuMC4wIiwgcG9ydD1pbnQoc3lzLmFyZ3ZbMV0pKQ== | base64 --decode > mock_sts.py'] Command:[docker exec roottests3assumerole-gw9-resolver-1 bash -c echo aW1wb3J0IHN5cwoKZnJvbSBib3R0bGUgaW1wb3J0IHJlc3BvbnNlLCByb3V0ZSwgcnVuCgoKTU9DS19YTUxfUkVTUE9OU0UgPSAiIiI8QXNzdW1lUm9sZVJlc3BvbnNlIHhtbG5zPSJodHRwczovL3N0cy5hbWF6b25hd3MuY29tL2RvYy8yMDExLTA2LTE1LyI+CiAgPEFzc3VtZVJvbGVSZXN1bHQ+CiAgICA8Q3JlZGVudGlhbHM+CiAgICAgIDxBY2Nlc3NLZXlJZD5taW5pbzwvQWNjZXNzS2V5SWQ+CiAgICAgIDxTZWNyZXRBY2Nlc3NLZXk+Q2xpY2tIb3VzZV9NaW5pb19QQHNzdzByZDwvU2VjcmV0QWNjZXNzS2V5PgogICAgICA8RXhwaXJhdGlvbj4yMDU1LTEyLTMxVDIzOjU5OjU5WjwvRXhwaXJhdGlvbj4KICAgIDwvQ3JlZGVudGlhbHM+CiAgPC9Bc3N1bWVSb2xlUmVzdWx0Pgo8L0Fzc3VtZVJvbGVSZXNwb25zZT4iIiIKCiMgPFNlc3Npb25Ub2tlbj5NT0NLX1NFU1NJT05fVE9LRU48L1Nlc3Npb25Ub2tlbj4gIGlzIG5vdCBiZWluZyByZXR1cm5lZCAtLSBpdCBpcyBub3QgcmVxdWlyZWQgYnkgbWluaW8KIyBXaGVuICJyZWFsIiBTVFMgcmV0dXJucyBpdCAtLSBpdCBpcyBhbHNvIHVzZWQgdG8gcmVhZCBmcm9tIHMzCgpAcm91dGUoIi8iLCBtZXRob2Q9IlBPU1QiKQpkZWYgcmV0dXJuX2NyZWRzKCk6CiAgICByZXNwb25zZS5zdGF0dXMgPSAyMDAKICAgIHJlc3BvbnNlLmNvbnRlbnRfdHlwZSA9ICJhcHBsaWNhdGlvbi94bWwiCiAgICByZXR1cm4gTU9DS19YTUxfUkVTUE9OU0UKCgpAcm91dGUoIi8iLCBtZXRob2Q9IkdFVCIpCmRlZiBwaW5nKCk6CiAgICByZXR1cm4gIk9LIgoKCnJ1bihob3N0PSIwLjAuMC4wIiwgcG9ydD1pbnQoc3lzLmFyZ3ZbMV0pKQ== | base64 --decode > mock_sts.py] run container_id:roottests3assumerole-gw9-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 mock_sts.py 8081 >/var/log/resolver/mock_sts.log 2>/var/log/resolver/mock_sts.err.log'] Command:[docker exec roottests3assumerole-gw9-resolver-1 bash -c python3 mock_sts.py 8081 >/var/log/resolver/mock_sts.log 2>/var/log/resolver/mock_sts.err.log] run container_id:roottests3assumerole-gw9-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8081/'] Command:[docker exec roottests3assumerole-gw9-resolver-1 curl -s http://localhost:8081/] Exitcode:7 run container_id:roottests3assumerole-gw9-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8081/'] Command:[docker exec roottests3assumerole-gw9-resolver-1 curl -s http://localhost:8081/] Stdout:OK mock_sts.py answered OK on attempt 2 Mock server mock_sts.py started ------------------------------ Captured log setup ------------------------------ 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV DOCKER_KERBEROS_KDC_TAG 9391ecdee8d7 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV CLICKHOUSE_TESTS_SERVER_BIN_PATH /clickhouse (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV MSAN_OPTIONS abort_on_error=1 poison_in_dtor=1 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV JAVA_TOOL_OPTIONS -Djdk.attach.allowAttachSelf=true (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV TSAN_OPTIONS halt_on_error=1 abort_on_error=1 history_size=7 memory_limit_mb=46080 second_deadlock_stack=1 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV HOSTNAME 479ad35ad9f8 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV SHLVL 0 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV HOME /root (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV OLDPWD / (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV DOCKER_HELPER_TAG 5dc43a6382f0 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV PYTHONUNBUFFERED 1 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV DOCKER_PYTHON_BOTTLE_TAG caad4729259e (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV UBSAN_OPTIONS print_stacktrace=1 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV PYTEST_ADDOPTS --dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact]' 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1]' test_polymorphic_parts/test.py::test_polymorphic_parts_index test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive test_prometheus_endpoint/test.py::test_prometheus_endpoint test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_ttl test_quorum_inserts/test.py::test_simple_add_replica test_read_temporary_tables_on_failure/test.py::test_different_versions test_recovery_time_metric/test.py::test_recovery_time_metric test_redirect_url_storage/test.py::test_predefined_connection_configuration test_redirect_url_storage/test.py::test_url_with_globs test_redirect_url_storage/test.py::test_url_with_globs_and_failover test_redirect_url_storage/test.py::test_url_with_redirect_allowed test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed test_redirect_url_storage/test.py::test_url_without_redirect test_regexp_logger/test.py::test_regexp_pattern_update test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_zookeeper/test.py::test_reload_zookeeper 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replica_can_become_leader/test.py::test_can_become_leader test_replicated_database/test.py::test_all_groups_cluster 'test_replicated_database/test.py::test_alter_attach[MergeTree]' 'test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[MergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree]' test_replicated_database/test.py::test_alter_fetch test_replicated_database/test.py::test_alters_from_different_replicas test_replicated_database/test.py::test_auto_recovery test_replicated_database/test.py::test_create_replicated_table 'test_replicated_database/test.py::test_delete_from_table[MergeTree]' 'test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_detach_attach_table test_replicated_database/test.py::test_flatten_nested test_replicated_database/test.py::test_force_synchronous_settings test_replicated_database/test.py::test_modify_comment test_replicated_database/test.py::test_recover_digest_mismatch test_replicated_database/test.py::test_replicated_table_structure_alter test_replicated_database/test.py::test_server_uuid 'test_replicated_database/test.py::test_simple_alter_table[MergeTree]' 'test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_table_metadata_corruption test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable 'test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header]' test_s3_assume_role/test.py::test_using_assumed_creds test_s3_cluster/test.py::test_ambiguous_join test_s3_cluster/test.py::test_cluster_default_expression test_s3_cluster/test.py::test_cluster_format_detection test_s3_cluster/test.py::test_cluster_with_header test_s3_cluster/test.py::test_cluster_with_named_collection test_s3_cluster/test.py::test_count test_s3_cluster/test.py::test_count_macro test_s3_cluster/test.py::test_distributed_insert_select_with_replicated test_s3_cluster/test.py::test_distributed_s3_table_engine test_s3_cluster/test.py::test_hive_partitioning test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference test_s3_cluster/test.py::test_remote_hedged test_s3_cluster/test.py::test_remote_no_hedged test_s3_cluster/test.py::test_select_all test_s3_cluster/test.py::test_skip_unavailable_shards test_s3_cluster/test.py::test_union_all test_s3_cluster/test.py::test_unset_skip_unavailable_shards test_s3_cluster/test.py::test_wrong_cluster test_send_crash_reports/test.py::test_send_segfault 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6]' test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session -vvv (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV CLICKHOUSE_LIBRARY_BRIDGE_BINARY_PATH /clickhouse-library-bridge (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV COMPOSE_HTTP_TIMEOUT 600 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV DOCKER_MYSQL_PHP_CLIENT_TAG 88be89c1e3b6 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV DOCKER_DOTNET_CLIENT_TAG 11de0b29a15d (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV CLICKHOUSE_TESTS_CLIENT_BIN_PATH /clickhouse (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV DOCKER_MYSQL_JS_CLIENT_TAG 41ba7c2ec2a1 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV CLICKHOUSE_USE_OLD_ANALYZER 1 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV PATH /spark-3.3.2-bin-hadoop3/bin:/opt/gdb/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV DOCKER_KERBERIZED_HADOOP_TAG latest (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV DOCKER_CHANNEL stable (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV DOCKER_CLIENT_TIMEOUT 300 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV DOCKER_POSTGRESQL_JAVA_CLIENT_TAG a4eff5c7f4d6 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV DOCKER_NGINX_DAV_TAG b55ac9cd7519 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV DOCKER_MYSQL_GOLANG_CLIENT_TAG 9bec2a638e6e (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV PWD /ClickHouse/tests/integration (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV DOCKER_MYSQL_JAVA_CLIENT_TAG 766bff31cfe4 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV CLICKHOUSE_ODBC_BRIDGE_BINARY_PATH /clickhouse-odbc-bridge (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV CLICKHOUSE_TESTS_BASE_CONFIG_DIR /clickhouse-config (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV TZ Etc/UTC (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV JAVA_PATH /usr/lib/jvm/java-11-openjdk-amd64/bin/java (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV DOCKER_BASE_TAG 6712d5cc610d (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV SPARK_HOME /spark-3.3.2-bin-hadoop3 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV LC_CTYPE C.UTF-8 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV INTEGRATION_TESTS_RUN_ID 0 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV WORKER_FREE_PORTS 30450 30451 30452 30453 30454 30455 30456 30457 30458 30459 30460 30461 30462 30463 30464 30465 30466 30467 30468 30469 30470 30471 30472 30473 30474 30475 30476 30477 30478 30479 30480 30481 30482 30483 30484 30485 30486 30487 30488 30489 30490 30491 30492 30493 30494 30495 30496 30497 30498 30499 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV PYTEST_XDIST_TESTRUNUID bb012ce1fe4a4fa6b434dc1157876ebd (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV PYTEST_XDIST_WORKER gw9 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV PYTEST_XDIST_WORKER_COUNT 10 (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : ENV PYTEST_CURRENT_TEST test_s3_assume_role/test.py::test_using_assumed_creds (setup) (cluster.py:450, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : CLUSTER INIT base_config_dir:/clickhouse-config (cluster.py:774, __init__) 2025-04-03 23:00:05 [ 736 ] DEBUG : clickhouse_start_command: clickhouse server --config-file=/etc/clickhouse-server/{main_config_file} --log-file=/var/log/clickhouse-server/clickhouse-server.log --errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log (cluster.py:1729, add_instance) 2025-04-03 23:00:05 [ 736 ] DEBUG : Cluster name: project_name:roottests3assumerole-gw9. Added instance name:node1 tag:6712d5cc610d base_cmd:['docker', 'compose', '--env-file', '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env', '--project-name', 'roottests3assumerole-gw9', '--file', '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/docker-compose.yml', '--file', '/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml'] docker_compose_yml_dir:/ClickHouse/tests/integration/helpers/../../../tests/integration/compose/ (cluster.py:2025, add_instance) 2025-04-03 23:00:05 [ 736 ] INFO : Starting cluster... (test.py:32, started_cluster) 2025-04-03 23:00:05 [ 736 ] INFO : Running tests in /ClickHouse/tests/integration/test_s3_assume_role/test.py (cluster.py:2793, start) 2025-04-03 23:00:05 [ 736 ] DEBUG : Cluster start called. is_up=False (cluster.py:2800, start) 2025-04-03 23:00:05 [ 736 ] DEBUG : Docker networks for project roottests3assumerole-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:873, print_all_docker_pieces) 2025-04-03 23:00:05 [ 736 ] DEBUG : Docker containers for project roottests3assumerole-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:881, print_all_docker_pieces) 2025-04-03 23:00:05 [ 736 ] DEBUG : Docker volumes for project roottests3assumerole-gw9 are DRIVER VOLUME NAME (cluster.py:889, print_all_docker_pieces) 2025-04-03 23:00:05 [ 736 ] DEBUG : Cleanup called (cluster.py:894, cleanup) 2025-04-03 23:00:05 [ 736 ] DEBUG : Docker networks for project roottests3assumerole-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:873, print_all_docker_pieces) 2025-04-03 23:00:05 [ 736 ] DEBUG : Docker containers for project roottests3assumerole-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:881, print_all_docker_pieces) 2025-04-03 23:00:05 [ 736 ] DEBUG : Docker volumes for project roottests3assumerole-gw9 are DRIVER VOLUME NAME (cluster.py:889, print_all_docker_pieces) 2025-04-03 23:00:05 [ 736 ] DEBUG : Command:[docker container list --all --filter name='^/roottests3assumerole-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:122, run_and_check) 2025-04-03 23:00:05 [ 736 ] DEBUG : Unstopped containers: {} (cluster.py:908, cleanup) 2025-04-03 23:00:05 [ 736 ] DEBUG : No running containers for project: roottests3assumerole-gw9 (cluster.py:922, cleanup) 2025-04-03 23:00:05 [ 736 ] DEBUG : Trying to prune unused networks... (cluster.py:928, cleanup) 2025-04-03 23:00:05 [ 736 ] DEBUG : Trying to prune unused images... (cluster.py:944, cleanup) 2025-04-03 23:00:05 [ 736 ] DEBUG : Command:[docker image prune -f] (cluster.py:122, run_and_check) 2025-04-03 23:00:05 [ 736 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:146, run_and_check) 2025-04-03 23:00:05 [ 736 ] DEBUG : Images pruned (cluster.py:947, cleanup) 2025-04-03 23:00:05 [ 736 ] DEBUG : Trying to prune unused volumes... (cluster.py:953, cleanup) 2025-04-03 23:00:05 [ 736 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:122, run_and_check) 2025-04-03 23:00:05 [ 736 ] DEBUG : Stdout:4 (cluster.py:146, run_and_check) 2025-04-03 23:00:05 [ 736 ] DEBUG : Command:[docker volume prune -f] (cluster.py:122, run_and_check) 2025-04-03 23:00:05 [ 736 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:146, run_and_check) 2025-04-03 23:00:05 [ 736 ] DEBUG : Volumes pruned: 4 (cluster.py:958, cleanup) 2025-04-03 23:00:05 [ 736 ] DEBUG : Setup directory for instance: node1 (cluster.py:2813, start) 2025-04-03 23:00:05 [ 736 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4639, create_dir) 2025-04-03 23:00:05 [ 736 ] DEBUG : Create directory for common tests configuration (cluster.py:4644, create_dir) 2025-04-03 23:00:05 [ 736 ] DEBUG : Copy common configuration from helpers (cluster.py:4664, create_dir) 2025-04-03 23:00:05 [ 736 ] DEBUG : Generate and write macros file (cluster.py:4716, create_dir) 2025-04-03 23:00:05 [ 736 ] DEBUG : Copy custom test config files [] to /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/configs/config.d (cluster.py:4752, create_dir) 2025-04-03 23:00:05 [ 736 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/database (cluster.py:4769, create_dir) 2025-04-03 23:00:05 [ 736 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/logs (cluster.py:4780, create_dir) 2025-04-03 23:00:05 [ 736 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log", "--"] (cluster.py:4864, create_dir) 2025-04-03 23:00:05 [ 736 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'MINIO_CERTS_DIR': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/minio/certs', 'MINIO_DATA_DIR': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/minio/data', 'MINIO_PORT': '9001', 'SSL_CERT_FILE': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/minio/certs/public.crt', 'RESOLVER_LOGS': '/ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/resolver', 'RESOLVER_LOGS_FS': 'bind'} stored in /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env (cluster.py:97, _create_env_file) 2025-04-03 23:00:05 [ 736 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-04-03 23:00:05 [ 736 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-04-03 23:00:05 [ 736 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2025-04-03 23:00:05 [ 736 ] DEBUG : No config file found (config.py:28, find_config_file) 2025-04-03 23:00:05 [ 736 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:547, _make_request) 2025-04-03 23:00:05 [ 736 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env --project-name roottests3assumerole-gw9 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml pull] (cluster.py:122, run_and_check) 2025-04-03 23:00:16 [ 736 ] DEBUG : Stderr: proxy2 Skipped - Image is already being pulled by proxy1 (cluster.py:148, run_and_check) 2025-04-03 23:00:16 [ 736 ] DEBUG : Stderr: node1 Pulling (cluster.py:148, run_and_check) 2025-04-03 23:00:16 [ 736 ] DEBUG : Stderr: minio1 Pulling (cluster.py:148, run_and_check) 2025-04-03 23:00:16 [ 736 ] DEBUG : Stderr: proxy1 Pulling (cluster.py:148, run_and_check) 2025-04-03 23:00:16 [ 736 ] DEBUG : Stderr: resolver Pulling (cluster.py:148, run_and_check) 2025-04-03 23:00:16 [ 736 ] DEBUG : Stderr: resolver Pulled (cluster.py:148, run_and_check) 2025-04-03 23:00:16 [ 736 ] DEBUG : Stderr: minio1 Pulled (cluster.py:148, run_and_check) 2025-04-03 23:00:16 [ 736 ] DEBUG : Stderr: proxy1 Pulled (cluster.py:148, run_and_check) 2025-04-03 23:00:16 [ 736 ] DEBUG : Stderr: node1 Pulled (cluster.py:148, run_and_check) 2025-04-03 23:00:16 [ 736 ] INFO : Trying to create Minio instance by command docker compose --project-name roottests3assumerole-gw9 --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d (cluster.py:3132, start) 2025-04-03 23:00:16 [ 736 ] DEBUG : Command:[docker compose --project-name roottests3assumerole-gw9 --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml --verbose up -d] (cluster.py:122, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr:time="2025-04-03T23:00:16Z" level=trace msg="Docker Desktop integration not enabled" (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Network roottests3assumerole-gw9_default Creating (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Network roottests3assumerole-gw9_default Created (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Volume "roottests3assumerole-gw9_data1-1" Creating (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Volume "roottests3assumerole-gw9_data1-1" Created (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy1-1 Creating (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy2-1 Creating (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: proxy2 The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64/v3) and no specific platform was requested (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy2-1 Created (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: proxy1 The requested image's platform (linux/arm64/v8) does not match the detected host platform (linux/amd64/v3) and no specific platform was requested (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy1-1 Created (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-minio1-1 Creating (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-resolver-1 Creating (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-resolver-1 Created (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-minio1-1 Created (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy2-1 Starting (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy1-1 Starting (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy2-1 Started (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy1-1 Started (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-minio1-1 Starting (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-resolver-1 Starting (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-minio1-1 Started (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-resolver-1 Started (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr:time="2025-04-03T23:00:17Z" level=debug msg="otel error" error="" (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] DEBUG : Stderr:time="2025-04-03T23:00:17Z" level=debug msg="otel error" error="" (cluster.py:148, run_and_check) 2025-04-03 23:00:17 [ 736 ] INFO : Trying to connect to Minio... (cluster.py:3138, start) 2025-04-03 23:00:17 [ 736 ] DEBUG : get_instance_ip instance_name=minio1 (cluster.py:2082, get_instance_ip) 2025-04-03 23:00:17 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw9-minio1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:17 [ 736 ] DEBUG : get_instance_ip instance_name=proxy1 (cluster.py:2082, get_instance_ip) 2025-04-03 23:00:17 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw9-proxy1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:17 [ 736 ] DEBUG : Starting new HTTP connection (1): 172.16.2.5:9001 (connectionpool.py:245, _new_conn) 2025-04-03 23:00:17 [ 736 ] DEBUG : Incremented Retry for (url='/'): Retry(total=2, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment) 2025-04-03 23:00:17 [ 736 ] WARNING : Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:872, urlopen) 2025-04-03 23:00:17 [ 736 ] DEBUG : Starting new HTTP connection (2): 172.16.2.5:9001 (connectionpool.py:245, _new_conn) 2025-04-03 23:00:17 [ 736 ] DEBUG : Incremented Retry for (url='/'): Retry(total=1, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment) 2025-04-03 23:00:17 [ 736 ] WARNING : Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:872, urlopen) 2025-04-03 23:00:17 [ 736 ] DEBUG : Starting new HTTP connection (3): 172.16.2.5:9001 (connectionpool.py:245, _new_conn) 2025-04-03 23:00:17 [ 736 ] DEBUG : Incremented Retry for (url='/'): Retry(total=0, connect=None, read=None, redirect=None, status=None) (retry.py:517, increment) 2025-04-03 23:00:17 [ 736 ] WARNING : Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')': / (connectionpool.py:872, urlopen) 2025-04-03 23:00:17 [ 736 ] DEBUG : Starting new HTTP connection (4): 172.16.2.5:9001 (connectionpool.py:245, _new_conn) 2025-04-03 23:00:17 [ 736 ] DEBUG : Can't connect to Minio: HTTPConnectionPool(host='172.16.2.5', port=9001): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) (cluster.py:2637, wait_minio_to_start) 2025-04-03 23:00:18 [ 736 ] DEBUG : Starting new HTTP connection (5): 172.16.2.5:9001 (connectionpool.py:245, _new_conn) 2025-04-03 23:00:18 [ 736 ] DEBUG : http://172.16.2.5:9001 "GET / HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-03 23:00:18 [ 736 ] DEBUG : Connected to Minio. (cluster.py:2617, wait_minio_to_start) 2025-04-03 23:00:18 [ 736 ] DEBUG : http://172.16.2.5:9001 "GET /root?location= HTTP/1.1" 404 0 (connectionpool.py:547, _make_request) 2025-04-03 23:00:18 [ 736 ] DEBUG : http://172.16.2.5:9001 "PUT /root HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-03 23:00:18 [ 736 ] DEBUG : S3 bucket 'root' created (cluster.py:2632, wait_minio_to_start) 2025-04-03 23:00:18 [ 736 ] DEBUG : http://172.16.2.5:9001 "GET /root2?location= HTTP/1.1" 404 0 (connectionpool.py:547, _make_request) 2025-04-03 23:00:18 [ 736 ] DEBUG : http://172.16.2.5:9001 "PUT /root2 HTTP/1.1" 200 0 (connectionpool.py:547, _make_request) 2025-04-03 23:00:18 [ 736 ] DEBUG : S3 bucket 'root2' created (cluster.py:2632, wait_minio_to_start) 2025-04-03 23:00:18 [ 736 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env --project-name roottests3assumerole-gw9 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate') (cluster.py:3200, start) 2025-04-03 23:00:18 [ 736 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env --project-name roottests3assumerole-gw9 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml up -d --no-recreate] (cluster.py:122, run_and_check) 2025-04-03 23:00:19 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy2-1 Running (cluster.py:148, run_and_check) 2025-04-03 23:00:19 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy1-1 Running (cluster.py:148, run_and_check) 2025-04-03 23:00:19 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-resolver-1 Running (cluster.py:148, run_and_check) 2025-04-03 23:00:19 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-minio1-1 Running (cluster.py:148, run_and_check) 2025-04-03 23:00:19 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-node1-1 Creating (cluster.py:148, run_and_check) 2025-04-03 23:00:19 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-node1-1 Created (cluster.py:148, run_and_check) 2025-04-03 23:00:19 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-node1-1 Starting (cluster.py:148, run_and_check) 2025-04-03 23:00:19 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-node1-1 Started (cluster.py:148, run_and_check) 2025-04-03 23:00:19 [ 736 ] DEBUG : ClickHouse instance created (cluster.py:3208, start) 2025-04-03 23:00:19 [ 736 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2082, get_instance_ip) 2025-04-03 23:00:19 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw9-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:19 [ 736 ] DEBUG : get_instance_ip instance_name=node1 (cluster.py:2092, get_instance_global_ipv6) 2025-04-03 23:00:19 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw9-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:19 [ 736 ] DEBUG : Waiting for ClickHouse start in node1, ip: 172.16.2.6... (cluster.py:3216, start) 2025-04-03 23:00:19 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/roottests3assumerole-gw9-node1-1/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:19 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:19 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:19 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:19 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:19 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:19 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:19 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:19 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:20 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:20 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:20 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:20 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:20 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:20 [ 736 ] DEBUG : http://localhost:None "GET /v1.46/containers/e237596d5715b0f30084bd4bbe69004d003b3e0c5e014dd946c65abc49f5362b/json HTTP/1.1" 200 None (connectionpool.py:547, _make_request) 2025-04-03 23:00:20 [ 736 ] DEBUG : ClickHouse node1 started (cluster.py:3220, start) 2025-04-03 23:00:20 [ 736 ] INFO : Starting mock server mock_sts.py (mock_servers.py:18, start_mock_servers) 2025-04-03 23:00:20 [ 736 ] DEBUG : run container_id:roottests3assumerole-gw9-resolver-1 detach:False nothrow:False cmd: ['bash', '-c', 'echo aW1wb3J0IHN5cwoKZnJvbSBib3R0bGUgaW1wb3J0IHJlc3BvbnNlLCByb3V0ZSwgcnVuCgoKTU9DS19YTUxfUkVTUE9OU0UgPSAiIiI8QXNzdW1lUm9sZVJlc3BvbnNlIHhtbG5zPSJodHRwczovL3N0cy5hbWF6b25hd3MuY29tL2RvYy8yMDExLTA2LTE1LyI+CiAgPEFzc3VtZVJvbGVSZXN1bHQ+CiAgICA8Q3JlZGVudGlhbHM+CiAgICAgIDxBY2Nlc3NLZXlJZD5taW5pbzwvQWNjZXNzS2V5SWQ+CiAgICAgIDxTZWNyZXRBY2Nlc3NLZXk+Q2xpY2tIb3VzZV9NaW5pb19QQHNzdzByZDwvU2VjcmV0QWNjZXNzS2V5PgogICAgICA8RXhwaXJhdGlvbj4yMDU1LTEyLTMxVDIzOjU5OjU5WjwvRXhwaXJhdGlvbj4KICAgIDwvQ3JlZGVudGlhbHM+CiAgPC9Bc3N1bWVSb2xlUmVzdWx0Pgo8L0Fzc3VtZVJvbGVSZXNwb25zZT4iIiIKCiMgPFNlc3Npb25Ub2tlbj5NT0NLX1NFU1NJT05fVE9LRU48L1Nlc3Npb25Ub2tlbj4gIGlzIG5vdCBiZWluZyByZXR1cm5lZCAtLSBpdCBpcyBub3QgcmVxdWlyZWQgYnkgbWluaW8KIyBXaGVuICJyZWFsIiBTVFMgcmV0dXJucyBpdCAtLSBpdCBpcyBhbHNvIHVzZWQgdG8gcmVhZCBmcm9tIHMzCgpAcm91dGUoIi8iLCBtZXRob2Q9IlBPU1QiKQpkZWYgcmV0dXJuX2NyZWRzKCk6CiAgICByZXNwb25zZS5zdGF0dXMgPSAyMDAKICAgIHJlc3BvbnNlLmNvbnRlbnRfdHlwZSA9ICJhcHBsaWNhdGlvbi94bWwiCiAgICByZXR1cm4gTU9DS19YTUxfUkVTUE9OU0UKCgpAcm91dGUoIi8iLCBtZXRob2Q9IkdFVCIpCmRlZiBwaW5nKCk6CiAgICByZXR1cm4gIk9LIgoKCnJ1bihob3N0PSIwLjAuMC4wIiwgcG9ydD1pbnQoc3lzLmFyZ3ZbMV0pKQ== | base64 --decode > mock_sts.py'] (cluster.py:2126, exec_in_container) 2025-04-03 23:00:20 [ 736 ] DEBUG : Command:[docker exec roottests3assumerole-gw9-resolver-1 bash -c echo aW1wb3J0IHN5cwoKZnJvbSBib3R0bGUgaW1wb3J0IHJlc3BvbnNlLCByb3V0ZSwgcnVuCgoKTU9DS19YTUxfUkVTUE9OU0UgPSAiIiI8QXNzdW1lUm9sZVJlc3BvbnNlIHhtbG5zPSJodHRwczovL3N0cy5hbWF6b25hd3MuY29tL2RvYy8yMDExLTA2LTE1LyI+CiAgPEFzc3VtZVJvbGVSZXN1bHQ+CiAgICA8Q3JlZGVudGlhbHM+CiAgICAgIDxBY2Nlc3NLZXlJZD5taW5pbzwvQWNjZXNzS2V5SWQ+CiAgICAgIDxTZWNyZXRBY2Nlc3NLZXk+Q2xpY2tIb3VzZV9NaW5pb19QQHNzdzByZDwvU2VjcmV0QWNjZXNzS2V5PgogICAgICA8RXhwaXJhdGlvbj4yMDU1LTEyLTMxVDIzOjU5OjU5WjwvRXhwaXJhdGlvbj4KICAgIDwvQ3JlZGVudGlhbHM+CiAgPC9Bc3N1bWVSb2xlUmVzdWx0Pgo8L0Fzc3VtZVJvbGVSZXNwb25zZT4iIiIKCiMgPFNlc3Npb25Ub2tlbj5NT0NLX1NFU1NJT05fVE9LRU48L1Nlc3Npb25Ub2tlbj4gIGlzIG5vdCBiZWluZyByZXR1cm5lZCAtLSBpdCBpcyBub3QgcmVxdWlyZWQgYnkgbWluaW8KIyBXaGVuICJyZWFsIiBTVFMgcmV0dXJucyBpdCAtLSBpdCBpcyBhbHNvIHVzZWQgdG8gcmVhZCBmcm9tIHMzCgpAcm91dGUoIi8iLCBtZXRob2Q9IlBPU1QiKQpkZWYgcmV0dXJuX2NyZWRzKCk6CiAgICByZXNwb25zZS5zdGF0dXMgPSAyMDAKICAgIHJlc3BvbnNlLmNvbnRlbnRfdHlwZSA9ICJhcHBsaWNhdGlvbi94bWwiCiAgICByZXR1cm4gTU9DS19YTUxfUkVTUE9OU0UKCgpAcm91dGUoIi8iLCBtZXRob2Q9IkdFVCIpCmRlZiBwaW5nKCk6CiAgICByZXR1cm4gIk9LIgoKCnJ1bihob3N0PSIwLjAuMC4wIiwgcG9ydD1pbnQoc3lzLmFyZ3ZbMV0pKQ== | base64 --decode > mock_sts.py] (cluster.py:122, run_and_check) 2025-04-03 23:00:20 [ 736 ] DEBUG : run container_id:roottests3assumerole-gw9-resolver-1 detach:True nothrow:False cmd: ['bash', '-c', 'python3 mock_sts.py 8081 >/var/log/resolver/mock_sts.log 2>/var/log/resolver/mock_sts.err.log'] (cluster.py:2126, exec_in_container) 2025-04-03 23:00:20 [ 736 ] DEBUG : Command:[docker exec roottests3assumerole-gw9-resolver-1 bash -c python3 mock_sts.py 8081 >/var/log/resolver/mock_sts.log 2>/var/log/resolver/mock_sts.err.log] (cluster.py:122, run_and_check) 2025-04-03 23:00:20 [ 736 ] DEBUG : run container_id:roottests3assumerole-gw9-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8081/'] (cluster.py:2126, exec_in_container) 2025-04-03 23:00:20 [ 736 ] DEBUG : Command:[docker exec roottests3assumerole-gw9-resolver-1 curl -s http://localhost:8081/] (cluster.py:122, run_and_check) 2025-04-03 23:00:20 [ 736 ] DEBUG : Exitcode:7 (cluster.py:150, run_and_check) 2025-04-03 23:00:21 [ 736 ] DEBUG : run container_id:roottests3assumerole-gw9-resolver-1 detach:False nothrow:True cmd: ['curl', '-s', 'http://localhost:8081/'] (cluster.py:2126, exec_in_container) 2025-04-03 23:00:21 [ 736 ] DEBUG : Command:[docker exec roottests3assumerole-gw9-resolver-1 curl -s http://localhost:8081/] (cluster.py:122, run_and_check) 2025-04-03 23:00:21 [ 736 ] DEBUG : Stdout:OK (cluster.py:146, run_and_check) 2025-04-03 23:00:21 [ 736 ] DEBUG : mock_sts.py answered OK on attempt 2 (mock_servers.py:67, start_mock_servers) 2025-04-03 23:00:21 [ 736 ] INFO : Mock server mock_sts.py started (mock_servers.py:82, start_mock_servers) ----------------------------- Captured stderr call ----------------------------- Executing query INSERT INTO FUNCTION s3 ( 'http://minio1:9001/root/test_assume.csv', 'minio', 'ClickHouse_Minio_P@ssw0rd', 'CSVWithNames' ) SELECT number as num, toString(number) as strnum FROM numbers(5); on node1 ------------------------------ Captured log call ------------------------------- 2025-04-03 23:00:21 [ 736 ] DEBUG : Executing query INSERT INTO FUNCTION s3 ( 'http://minio1:9001/root/test_assume.csv', 'minio', 'ClickHouse_Minio_P@ssw0rd', 'CSVWithNames' ) SELECT number as num, toString(number) as strnum FROM numbers(5); on node1 (cluster.py:3677, query) --------------------------- Captured stderr teardown --------------------------- Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env --project-name roottests3assumerole-gw9 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] Stderr: Container roottests3assumerole-gw9-node1-1 Stopping Stderr: Container roottests3assumerole-gw9-resolver-1 Stopping Stderr: Container roottests3assumerole-gw9-node1-1 Stopped Stderr: Container roottests3assumerole-gw9-minio1-1 Stopping Stderr: Container roottests3assumerole-gw9-minio1-1 Stopped Stderr: Container roottests3assumerole-gw9-resolver-1 Stopped Stderr: Container roottests3assumerole-gw9-proxy2-1 Stopping Stderr: Container roottests3assumerole-gw9-proxy1-1 Stopping Stderr: Container roottests3assumerole-gw9-proxy1-1 Stopped Stderr: Container roottests3assumerole-gw9-proxy2-1 Stopped Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env --project-name roottests3assumerole-gw9 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] Stderr: Container roottests3assumerole-gw9-node1-1 Stopping Stderr: Container roottests3assumerole-gw9-resolver-1 Stopping Stderr: Container roottests3assumerole-gw9-node1-1 Stopped Stderr: Container roottests3assumerole-gw9-node1-1 Removing Stderr: Container roottests3assumerole-gw9-resolver-1 Stopped Stderr: Container roottests3assumerole-gw9-resolver-1 Removing Stderr: Container roottests3assumerole-gw9-node1-1 Removed Stderr: Container roottests3assumerole-gw9-minio1-1 Stopping Stderr: Container roottests3assumerole-gw9-minio1-1 Stopped Stderr: Container roottests3assumerole-gw9-minio1-1 Removing Stderr: Container roottests3assumerole-gw9-resolver-1 Removed Stderr: Container roottests3assumerole-gw9-minio1-1 Removed Stderr: Container roottests3assumerole-gw9-proxy1-1 Stopping Stderr: Container roottests3assumerole-gw9-proxy2-1 Stopping Stderr: Container roottests3assumerole-gw9-proxy1-1 Stopped Stderr: Container roottests3assumerole-gw9-proxy1-1 Removing Stderr: Container roottests3assumerole-gw9-proxy2-1 Stopped Stderr: Container roottests3assumerole-gw9-proxy2-1 Removing Stderr: Container roottests3assumerole-gw9-proxy1-1 Removed Stderr: Container roottests3assumerole-gw9-proxy2-1 Removed Stderr: Volume roottests3assumerole-gw9_data1-1 Removing Stderr: Network roottests3assumerole-gw9_default Removing Stderr: Volume roottests3assumerole-gw9_data1-1 Removed Stderr: Network roottests3assumerole-gw9_default Removed Cleanup called Docker networks for project roottests3assumerole-gw9 are NETWORK ID NAME DRIVER SCOPE Docker containers for project roottests3assumerole-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES Docker volumes for project roottests3assumerole-gw9 are DRIVER VOLUME NAME Command:[docker container list --all --filter name='^/roottests3assumerole-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] Unstopped containers: {} No running containers for project: roottests3assumerole-gw9 Trying to prune unused networks... Trying to prune unused images... Command:[docker image prune -f] Stdout:Total reclaimed space: 0B Images pruned Trying to prune unused volumes... Command:[docker volume ls | wc -l] Stdout:4 Command:[docker volume prune -f] Stdout:Total reclaimed space: 0B Volumes pruned: 4 ---------------------------- Captured log teardown ----------------------------- 2025-04-03 23:00:22 [ 736 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env --project-name roottests3assumerole-gw9 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml stop --timeout 20] (cluster.py:122, run_and_check) 2025-04-03 23:00:43 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-node1-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:00:43 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-resolver-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:00:43 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-node1-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:00:43 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-minio1-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:00:43 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-minio1-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:00:43 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-resolver-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:00:43 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy2-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:00:43 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy1-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:00:43 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy1-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:00:43 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy2-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:00:43 [ 736 ] DEBUG : Command:[bash -c [ -f /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/logs/stderr.log* | ( [ -z "" ] && cat || grep -v "$" ) || true] (cluster.py:122, run_and_check) 2025-04-03 23:00:43 [ 736 ] DEBUG : Command:[docker compose --env-file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/.env --project-name roottests3assumerole-gw9 --file /ClickHouse/tests/integration/test_s3_assume_role/_instances-0-gw9/node1/docker-compose.yml --file /ClickHouse/tests/integration/helpers/../../../tests/integration/compose/docker_compose_minio.yml down --volumes] (cluster.py:122, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-node1-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-resolver-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-node1-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-node1-1 Removing (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-resolver-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-resolver-1 Removing (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-node1-1 Removed (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-minio1-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-minio1-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-minio1-1 Removing (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-resolver-1 Removed (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-minio1-1 Removed (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy1-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy2-1 Stopping (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy1-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy1-1 Removing (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy2-1 Stopped (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy2-1 Removing (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy1-1 Removed (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Container roottests3assumerole-gw9-proxy2-1 Removed (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Volume roottests3assumerole-gw9_data1-1 Removing (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Network roottests3assumerole-gw9_default Removing (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Volume roottests3assumerole-gw9_data1-1 Removed (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stderr: Network roottests3assumerole-gw9_default Removed (cluster.py:148, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Cleanup called (cluster.py:894, cleanup) 2025-04-03 23:00:44 [ 736 ] DEBUG : Docker networks for project roottests3assumerole-gw9 are NETWORK ID NAME DRIVER SCOPE (cluster.py:873, print_all_docker_pieces) 2025-04-03 23:00:44 [ 736 ] DEBUG : Docker containers for project roottests3assumerole-gw9 are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:881, print_all_docker_pieces) 2025-04-03 23:00:44 [ 736 ] DEBUG : Docker volumes for project roottests3assumerole-gw9 are DRIVER VOLUME NAME (cluster.py:889, print_all_docker_pieces) 2025-04-03 23:00:44 [ 736 ] DEBUG : Command:[docker container list --all --filter name='^/roottests3assumerole-gw9-.*-1$' --format '{{.ID}}:{{.Names}}'] (cluster.py:122, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Unstopped containers: {} (cluster.py:908, cleanup) 2025-04-03 23:00:44 [ 736 ] DEBUG : No running containers for project: roottests3assumerole-gw9 (cluster.py:922, cleanup) 2025-04-03 23:00:44 [ 736 ] DEBUG : Trying to prune unused networks... (cluster.py:928, cleanup) 2025-04-03 23:00:44 [ 736 ] DEBUG : Trying to prune unused images... (cluster.py:944, cleanup) 2025-04-03 23:00:44 [ 736 ] DEBUG : Command:[docker image prune -f] (cluster.py:122, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:146, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Images pruned (cluster.py:947, cleanup) 2025-04-03 23:00:44 [ 736 ] DEBUG : Trying to prune unused volumes... (cluster.py:953, cleanup) 2025-04-03 23:00:44 [ 736 ] DEBUG : Command:[docker volume ls | wc -l] (cluster.py:122, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stdout:4 (cluster.py:146, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Command:[docker volume prune -f] (cluster.py:122, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:146, run_and_check) 2025-04-03 23:00:44 [ 736 ] DEBUG : Volumes pruned: 4 (cluster.py:958, cleanup) =============================== warnings summary =============================== test_reload_client_certificate/test.py: 36 warnings /usr/local/lib/python3.10/dist-packages/kazoo/handlers/utils.py:225: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated context = ssl.SSLContext(ssl.PROTOCOL_SSLv23) -- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html ============================== slowest durations =============================== 177.57s call test_reload_client_certificate/test.py::test_wrong_cn_cert 77.61s setup test_redirect_url_storage/test.py::test_predefined_connection_configuration 49.54s call test_replicated_database/test.py::test_recover_digest_mismatch 48.18s call test_replicated_database/test.py::test_alters_from_different_replicas 36.54s call test_reload_client_certificate/test.py::test_correct_cn_cert 34.47s call test_reload_zookeeper/test.py::test_reload_zookeeper 32.81s call test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] 32.71s call test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] 30.06s call test_replicated_database/test.py::test_modify_comment 29.46s setup test_s3_cluster/test.py::test_ambiguous_join 28.28s call test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 23.73s setup test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] 23.53s teardown test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header] 23.28s teardown test_s3_cluster/test.py::test_wrong_cluster 22.16s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format 22.09s setup test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 21.94s setup test_replicated_database/test.py::test_all_groups_cluster 21.72s teardown test_redirect_url_storage/test.py::test_url_without_redirect 21.69s teardown test_s3_assume_role/test.py::test_using_assumed_creds 21.12s setup test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 19.99s call test_quorum_inserts/test.py::test_insert_quorum_with_ttl 19.74s call test_replicated_database/test.py::test_force_synchronous_settings 19.66s setup test_replica_can_become_leader/test.py::test_can_become_leader 19.38s setup test_reload_client_certificate/test.py::test_correct_cn_cert 19.33s call test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 18.99s call test_replicated_database/test.py::test_auto_recovery 18.54s setup test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1] 18.21s teardown test_quorum_inserts/test.py::test_simple_add_replica 17.85s setup test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header] 17.14s setup test_reload_zookeeper/test.py::test_reload_zookeeper 16.20s setup test_s3_assume_role/test.py::test_using_assumed_creds 15.64s call test_recovery_time_metric/test.py::test_recovery_time_metric 15.30s setup test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 14.90s setup test_session_log/test.py::test_grpc_session 14.05s call test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers 14.00s call test_replicated_database/test.py::test_table_metadata_corruption 13.99s setup test_read_temporary_tables_on_failure/test.py::test_different_versions 13.95s setup test_prometheus_endpoint/test.py::test_prometheus_endpoint 13.83s call test_replicated_database/test.py::test_server_uuid 13.52s setup test_regexp_logger/test.py::test_regexp_pattern_update 13.44s setup test_send_crash_reports/test.py::test_send_segfault 13.26s setup test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers 12.79s teardown test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive 12.76s setup test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop 12.68s setup test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable 11.88s setup test_recovery_time_metric/test.py::test_recovery_time_metric 11.33s call test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 10.35s call test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 10.26s call test_replicated_database/test.py::test_replicated_table_structure_alter 10.00s call test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] 9.49s teardown test_read_temporary_tables_on_failure/test.py::test_different_versions 8.25s teardown test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop 7.22s call test_s3_cluster/test.py::test_hive_partitioning 6.92s teardown test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6] 6.64s teardown test_reload_zookeeper/test.py::test_reload_zookeeper 6.55s call test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] 6.55s call test_regexp_logger/test.py::test_regexp_pattern_update 6.53s call test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False] 6.36s call test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop 6.36s call test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3] 6.21s teardown test_replicated_database/test.py::test_table_metadata_corruption 5.94s teardown test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers 5.91s call test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 5.82s call test_s3_cluster/test.py::test_cluster_format_detection 5.78s call test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree] 5.74s call test_replicated_database/test.py::test_simple_alter_table[MergeTree] 5.71s call test_read_temporary_tables_on_failure/test.py::test_different_versions 5.61s call test_replicated_database/test.py::test_alter_attach[MergeTree] 5.46s call test_s3_cluster/test.py::test_cluster_default_expression 5.45s call test_replicated_database/test.py::test_flatten_nested 5.25s teardown test_replica_can_become_leader/test.py::test_can_become_leader 5.11s call test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable 5.06s teardown test_reload_client_certificate/test.py::test_wrong_cn_cert 4.91s call test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True] 4.87s call test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6] 4.83s call test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] 4.65s call test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] 4.41s call test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree] 4.23s teardown test_prometheus_endpoint/test.py::test_prometheus_endpoint 4.18s call test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2] 4.16s teardown test_session_log/test.py::test_mysql_session 4.07s call test_replicated_database/test.py::test_alter_fetch 4.01s call test_quorum_inserts/test.py::test_simple_add_replica 3.91s call test_s3_cluster/test.py::test_distributed_s3_table_engine 3.90s call test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5] 3.85s call test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True] 3.81s call test_replicated_database/test.py::test_alter_drop_partition[MergeTree] 3.79s call test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree] 3.77s call test_s3_cluster/test.py::test_distributed_insert_select_with_replicated 3.76s teardown test_regexp_logger/test.py::test_regexp_pattern_update 3.66s call test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree] 3.64s call test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False] 3.62s call test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] 3.54s call test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree] 3.53s call test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree] 3.49s call test_s3_cluster/test.py::test_union_all 3.45s call test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4] 3.43s call test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1] 3.36s teardown test_send_crash_reports/test.py::test_send_segfault 3.34s call test_replicated_database/test.py::test_delete_from_table[MergeTree] 3.30s call test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 3.26s call test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] 3.05s call test_s3_cluster/test.py::test_cluster_with_header 2.89s call test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree] 2.84s call test_replicated_database/test.py::test_create_replicated_table 2.75s call test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header] 2.62s call test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header] 2.55s call test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header] 2.53s call test_s3_cluster/test.py::test_cluster_with_named_collection 2.44s call test_replicated_database/test.py::test_alter_drop_part[MergeTree] 2.42s call test_replicated_database/test.py::test_alter_detach_part[MergeTree] 2.21s call test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree] 2.11s call test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive 2.07s call test_session_log/test.py::test_grpc_session 2.01s call test_polymorphic_parts/test.py::test_polymorphic_parts_index 1.98s call test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format 1.97s call test_session_log/test.py::test_mysql_session 1.96s call test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference 1.92s teardown test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 1.81s teardown test_recovery_time_metric/test.py::test_recovery_time_metric 1.77s call test_replicated_database/test.py::test_all_groups_cluster 1.66s call test_replicated_database/test.py::test_detach_attach_table 1.37s call test_s3_cluster/test.py::test_ambiguous_join 1.30s call test_s3_cluster/test.py::test_count 1.26s call test_redirect_url_storage/test.py::test_predefined_connection_configuration 1.21s teardown test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable 1.21s call test_s3_cluster/test.py::test_unset_skip_unavailable_shards 1.17s call test_s3_cluster/test.py::test_select_all 1.15s call test_prometheus_endpoint/test.py::test_prometheus_endpoint 1.13s setup test_replicated_database/test.py::test_alter_attach[MergeTree] 1.05s call test_s3_cluster/test.py::test_skip_unavailable_shards 1.01s call test_redirect_url_storage/test.py::test_url_with_globs 1.00s call test_s3_cluster/test.py::test_count_macro 0.92s call test_redirect_url_storage/test.py::test_url_with_globs_and_failover 0.84s call test_redirect_url_storage/test.py::test_url_without_redirect 0.83s call test_send_crash_reports/test.py::test_send_segfault 0.81s call test_s3_cluster/test.py::test_wrong_cluster 0.80s call test_s3_cluster/test.py::test_remote_no_hedged 0.75s call test_s3_cluster/test.py::test_remote_hedged 0.70s call test_redirect_url_storage/test.py::test_url_with_redirect_allowed 0.44s call test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed 0.43s call test_replica_can_become_leader/test.py::test_can_become_leader 0.32s call test_s3_assume_role/test.py::test_using_assumed_creds 0.01s teardown test_redirect_url_storage/test.py::test_predefined_connection_configuration 0.01s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] 0.01s teardown test_reload_client_certificate/test.py::test_correct_cn_cert 0.01s teardown test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 0.00s teardown test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] 0.00s setup test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False] 0.00s setup test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] 0.00s teardown test_s3_cluster/test.py::test_ambiguous_join 0.00s setup test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False] 0.00s teardown test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format 0.00s teardown test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] 0.00s setup test_polymorphic_parts/test.py::test_polymorphic_parts_index 0.00s setup test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header] 0.00s setup test_quorum_inserts/test.py::test_simple_add_replica 0.00s teardown test_s3_cluster/test.py::test_cluster_format_detection 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] 0.00s setup test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] 0.00s setup test_s3_cluster/test.py::test_cluster_with_header 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] 0.00s setup test_replicated_database/test.py::test_delete_from_table[MergeTree] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] 0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_ttl 0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False] 0.00s teardown test_replicated_database/test.py::test_server_uuid 0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 0.00s setup test_reload_client_certificate/test.py::test_wrong_cn_cert 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] 0.00s setup test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True] 0.00s setup test_replicated_database/test.py::test_auto_recovery 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] 0.00s teardown test_replicated_database/test.py::test_alter_attach[MergeTree] 0.00s setup test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2] 0.00s setup test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6] 0.00s teardown test_replicated_database/test.py::test_alters_from_different_replicas 0.00s setup test_s3_cluster/test.py::test_hive_partitioning 0.00s teardown test_s3_cluster/test.py::test_union_all 0.00s setup test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4] 0.00s setup test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive 0.00s teardown test_s3_cluster/test.py::test_distributed_s3_table_engine 0.00s setup test_replicated_database/test.py::test_flatten_nested 0.00s teardown test_polymorphic_parts/test.py::test_polymorphic_parts_index 0.00s setup test_replicated_database/test.py::test_alter_detach_part[MergeTree] 0.00s setup test_replicated_database/test.py::test_force_synchronous_settings 0.00s setup test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference 0.00s setup test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree] 0.00s setup test_replicated_database/test.py::test_simple_alter_table[MergeTree] 0.00s teardown test_replicated_database/test.py::test_delete_from_table[MergeTree] 0.00s setup test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree] 0.00s teardown test_s3_cluster/test.py::test_hive_partitioning 0.00s setup test_replicated_database/test.py::test_replicated_table_structure_alter 0.00s teardown test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header] 0.00s setup test_replicated_database/test.py::test_table_metadata_corruption 0.00s setup test_redirect_url_storage/test.py::test_url_with_globs 0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True] 0.00s setup test_s3_cluster/test.py::test_cluster_default_expression 0.00s teardown test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree] 0.00s teardown test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree] 0.00s setup test_replicated_database/test.py::test_alter_drop_partition[MergeTree] 0.00s teardown test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree] 0.00s setup test_replicated_database/test.py::test_detach_attach_table 0.00s teardown test_s3_cluster/test.py::test_cluster_with_header 0.00s setup test_s3_cluster/test.py::test_unset_skip_unavailable_shards 0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False] 0.00s teardown test_replicated_database/test.py::test_recover_digest_mismatch 0.00s teardown test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] 0.00s setup test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5] 0.00s setup test_replicated_database/test.py::test_server_uuid 0.00s setup test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree] 0.00s teardown test_replicated_database/test.py::test_alter_drop_partition[MergeTree] 0.00s teardown test_replicated_database/test.py::test_all_groups_cluster 0.00s teardown test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1] 0.00s setup test_quorum_inserts/test.py::test_insert_quorum_with_ttl 0.00s setup test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree] 0.00s setup test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] 0.00s setup test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3] 0.00s setup test_s3_cluster/test.py::test_distributed_s3_table_engine 0.00s setup test_replicated_database/test.py::test_alters_from_different_replicas 0.00s setup test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True] 0.00s teardown test_replicated_database/test.py::test_create_replicated_table 0.00s teardown test_replicated_database/test.py::test_flatten_nested 0.00s teardown test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3] 0.00s teardown test_replicated_database/test.py::test_detach_attach_table 0.00s setup test_replicated_database/test.py::test_alter_drop_part[MergeTree] 0.00s setup test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header] 0.00s setup test_replicated_database/test.py::test_modify_comment 0.00s teardown test_replicated_database/test.py::test_replicated_table_structure_alter 0.00s teardown test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree] 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] 0.00s setup test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree] 0.00s setup test_s3_cluster/test.py::test_remote_no_hedged 0.00s setup test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree] 0.00s setup test_redirect_url_storage/test.py::test_url_with_redirect_allowed 0.00s setup test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree] 0.00s teardown test_replicated_database/test.py::test_alter_fetch 0.00s teardown test_s3_cluster/test.py::test_select_all 0.00s setup test_s3_cluster/test.py::test_distributed_insert_select_with_replicated 0.00s setup test_s3_cluster/test.py::test_count_macro 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] 0.00s setup test_replicated_database/test.py::test_recover_digest_mismatch 0.00s setup test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] 0.00s setup test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree] 0.00s teardown test_s3_cluster/test.py::test_distributed_insert_select_with_replicated 0.00s teardown test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree] 0.00s call test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] 0.00s teardown test_s3_cluster/test.py::test_remote_no_hedged 0.00s setup test_redirect_url_storage/test.py::test_url_with_globs_and_failover 0.00s teardown test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5] 0.00s teardown test_s3_cluster/test.py::test_skip_unavailable_shards 0.00s teardown test_replicated_database/test.py::test_modify_comment 0.00s setup test_session_log/test.py::test_mysql_session 0.00s setup test_s3_cluster/test.py::test_remote_hedged 0.00s teardown test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4] 0.00s teardown test_replicated_database/test.py::test_alter_detach_part[MergeTree] 0.00s setup test_replicated_database/test.py::test_create_replicated_table 0.00s teardown test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 0.00s setup test_redirect_url_storage/test.py::test_url_without_redirect 0.00s teardown test_session_log/test.py::test_grpc_session 0.00s teardown test_redirect_url_storage/test.py::test_url_with_globs 0.00s setup test_s3_cluster/test.py::test_skip_unavailable_shards 0.00s teardown test_redirect_url_storage/test.py::test_url_with_globs_and_failover 0.00s teardown test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree] 0.00s setup test_s3_cluster/test.py::test_count 0.00s setup test_replicated_database/test.py::test_alter_fetch 0.00s setup test_s3_cluster/test.py::test_cluster_format_detection 0.00s teardown test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree] 0.00s setup test_s3_cluster/test.py::test_wrong_cluster 0.00s setup test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed 0.00s teardown test_replicated_database/test.py::test_force_synchronous_settings 0.00s teardown test_s3_cluster/test.py::test_count_macro 0.00s teardown test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree] 0.00s setup test_s3_cluster/test.py::test_union_all 0.00s teardown test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header] 0.00s teardown test_s3_cluster/test.py::test_cluster_default_expression 0.00s teardown test_replicated_database/test.py::test_simple_alter_table[MergeTree] 0.00s teardown test_s3_cluster/test.py::test_count 0.00s setup test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 0.00s teardown test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True] 0.00s setup test_s3_cluster/test.py::test_cluster_with_named_collection 0.00s teardown test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed 0.00s teardown test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference 0.00s teardown test_s3_cluster/test.py::test_remote_hedged 0.00s teardown test_replicated_database/test.py::test_alter_drop_part[MergeTree] 0.00s teardown test_s3_cluster/test.py::test_cluster_with_named_collection 0.00s setup test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 0.00s teardown test_replicated_database/test.py::test_auto_recovery 0.00s setup test_s3_cluster/test.py::test_select_all 0.00s teardown test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2] 0.00s call test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] 0.00s teardown test_redirect_url_storage/test.py::test_url_with_redirect_allowed 0.00s teardown test_s3_cluster/test.py::test_unset_skip_unavailable_shards 0.00s teardown test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] =========================== short test summary info ============================ FAILED test_s3_assume_role/test.py::test_using_assumed_creds - helpers.client... PASSED test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header] PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1] PASSED test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header] PASSED test_replicated_database/test.py::test_all_groups_cluster PASSED test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2] PASSED test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact] PASSED test_replicated_database/test.py::test_alter_attach[MergeTree] PASSED test_s3_cluster/test.py::test_ambiguous_join PASSED test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3] PASSED test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 PASSED test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide] PASSED test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4] PASSED test_s3_cluster/test.py::test_cluster_default_expression PASSED test_replicated_database/test.py::test_alter_detach_part[MergeTree] PASSED test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5] PASSED test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree] PASSED test_s3_cluster/test.py::test_cluster_format_detection PASSED test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree] PASSED test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6] PASSED test_s3_cluster/test.py::test_cluster_with_header PASSED test_s3_cluster/test.py::test_cluster_with_named_collection PASSED test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree] PASSED test_s3_cluster/test.py::test_count PASSED test_prometheus_endpoint/test.py::test_prometheus_endpoint PASSED test_s3_cluster/test.py::test_count_macro PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain] PASSED test_replicated_database/test.py::test_alter_drop_part[MergeTree] PASSED test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0] PASSED test_s3_cluster/test.py::test_distributed_insert_select_with_replicated PASSED test_reload_client_certificate/test.py::test_correct_cn_cert PASSED test_replicated_database/test.py::test_alter_drop_partition[MergeTree] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1] PASSED test_s3_cluster/test.py::test_distributed_s3_table_engine PASSED test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection PASSED test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree] PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2] PASSED test_replicated_database/test.py::test_alter_fetch PASSED test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False] PASSED test_s3_cluster/test.py::test_hive_partitioning PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0] PASSED test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3] PASSED test_s3_cluster/test.py::test_remote_hedged PASSED test_s3_cluster/test.py::test_remote_no_hedged PASSED test_read_temporary_tables_on_failure/test.py::test_different_versions PASSED test_s3_cluster/test.py::test_select_all PASSED test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True] PASSED test_s3_cluster/test.py::test_skip_unavailable_shards PASSED test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop PASSED test_s3_cluster/test.py::test_union_all PASSED test_s3_cluster/test.py::test_unset_skip_unavailable_shards PASSED test_s3_cluster/test.py::test_wrong_cluster PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4] PASSED test_redirect_url_storage/test.py::test_predefined_connection_configuration PASSED test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format PASSED test_redirect_url_storage/test.py::test_url_with_globs PASSED test_redirect_url_storage/test.py::test_url_with_globs_and_failover PASSED test_recovery_time_metric/test.py::test_recovery_time_metric PASSED test_redirect_url_storage/test.py::test_url_with_redirect_allowed PASSED test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed PASSED test_redirect_url_storage/test.py::test_url_without_redirect PASSED test_quorum_inserts/test.py::test_insert_quorum_with_ttl PASSED test_quorum_inserts/test.py::test_simple_add_replica PASSED test_regexp_logger/test.py::test_regexp_pattern_update PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1] PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_index PASSED test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive PASSED test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers PASSED test_replicated_database/test.py::test_alters_from_different_replicas PASSED test_replica_can_become_leader/test.py::test_can_become_leader PASSED test_reload_zookeeper/test.py::test_reload_zookeeper PASSED test_replicated_database/test.py::test_auto_recovery PASSED test_replicated_database/test.py::test_create_replicated_table PASSED test_replicated_database/test.py::test_delete_from_table[MergeTree] PASSED test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree] PASSED test_replicated_database/test.py::test_detach_attach_table PASSED test_replicated_database/test.py::test_flatten_nested PASSED test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable PASSED test_replicated_database/test.py::test_force_synchronous_settings PASSED test_replicated_database/test.py::test_modify_comment PASSED test_reload_client_certificate/test.py::test_wrong_cn_cert PASSED test_replicated_database/test.py::test_recover_digest_mismatch PASSED test_session_log/test.py::test_grpc_session PASSED test_replicated_database/test.py::test_replicated_table_structure_alter PASSED test_session_log/test.py::test_mysql_session PASSED test_replicated_database/test.py::test_server_uuid PASSED test_replicated_database/test.py::test_simple_alter_table[MergeTree] PASSED test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree] PASSED test_replicated_database/test.py::test_table_metadata_corruption SKIPPED [1] test_send_crash_reports/test.py:46: doesn't fit in timeouts for stacktrace generation ======= 1 failed, 98 passed, 1 skipped, 36 warnings in 315.20s (0:05:15) ======= Traceback (most recent call last): File "/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration/./runner", line 528, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_fv83un --privileged --dns-search='.' --memory=30709035008 --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=6712d5cc610d -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e CLICKHOUSE_USE_OLD_ANALYZER=1 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_compact-Compact]' 'test_polymorphic_parts/test.py::test_different_part_types_on_replicas[polymorphic_table_wide-Wide]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node0-second_node0]' 'test_polymorphic_parts/test.py::test_polymorphic_parts_basics[first_node1-second_node1]' test_polymorphic_parts/test.py::test_polymorphic_parts_index test_polymorphic_parts/test.py::test_polymorphic_parts_non_adaptive test_prometheus_endpoint/test.py::test_prometheus_endpoint test_quorum_inserts/test.py::test_drop_replica_and_achieve_quorum 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_drop_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_keeper_loss_connection 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[False]' 'test_quorum_inserts/test.py::test_insert_quorum_with_move_partition[True]' test_quorum_inserts/test.py::test_insert_quorum_with_ttl test_quorum_inserts/test.py::test_simple_add_replica test_read_temporary_tables_on_failure/test.py::test_different_versions test_recovery_time_metric/test.py::test_recovery_time_metric test_redirect_url_storage/test.py::test_predefined_connection_configuration test_redirect_url_storage/test.py::test_url_with_globs test_redirect_url_storage/test.py::test_url_with_globs_and_failover test_redirect_url_storage/test.py::test_url_with_redirect_allowed test_redirect_url_storage/test.py::test_url_with_redirect_not_allowed test_redirect_url_storage/test.py::test_url_without_redirect test_regexp_logger/test.py::test_regexp_pattern_update test_reload_auxiliary_zookeepers/test.py::test_reload_auxiliary_zookeepers test_reload_client_certificate/test.py::test_correct_cn_cert test_reload_client_certificate/test.py::test_wrong_cn_cert test_reload_max_table_size_to_drop/test.py::test_reload_max_table_size_to_drop test_reload_zookeeper/test.py::test_reload_zookeeper 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_log_table[s3_plain]' test_remote_blobs_naming/test_backward_compatibility.py::test_read_new_format 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case0]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case1]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case2]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case3]' 'test_remote_blobs_naming/test_backward_compatibility.py::test_replicated_merge_tree[test_case4]' test_remote_blobs_naming/test_backward_compatibility.py::test_write_new_format test_replica_can_become_leader/test.py::test_can_become_leader test_replicated_database/test.py::test_all_groups_cluster 'test_replicated_database/test.py::test_alter_attach[MergeTree]' 'test_replicated_database/test.py::test_alter_attach[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[MergeTree]' 'test_replicated_database/test.py::test_alter_detach_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_detached_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_part[ReplicatedMergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[MergeTree]' 'test_replicated_database/test.py::test_alter_drop_partition[ReplicatedMergeTree]' test_replicated_database/test.py::test_alter_fetch test_replicated_database/test.py::test_alters_from_different_replicas test_replicated_database/test.py::test_auto_recovery test_replicated_database/test.py::test_create_replicated_table 'test_replicated_database/test.py::test_delete_from_table[MergeTree]' 'test_replicated_database/test.py::test_delete_from_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_detach_attach_table test_replicated_database/test.py::test_flatten_nested test_replicated_database/test.py::test_force_synchronous_settings test_replicated_database/test.py::test_modify_comment test_replicated_database/test.py::test_recover_digest_mismatch test_replicated_database/test.py::test_replicated_table_structure_alter test_replicated_database/test.py::test_server_uuid 'test_replicated_database/test.py::test_simple_alter_table[MergeTree]' 'test_replicated_database/test.py::test_simple_alter_table[ReplicatedMergeTree]' test_replicated_database/test.py::test_table_metadata_corruption test_runtime_configurable_cache_size/test.py::test_query_cache_size_is_runtime_configurable 'test_s3_access_headers/test.py::test_custom_access_header[test_access_key_id_overrides_access_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_access_over_custom_header]' 'test_s3_access_headers/test.py::test_custom_access_header[test_named_coll_overrides_access_header]' test_s3_assume_role/test.py::test_using_assumed_creds test_s3_cluster/test.py::test_ambiguous_join test_s3_cluster/test.py::test_cluster_default_expression test_s3_cluster/test.py::test_cluster_format_detection test_s3_cluster/test.py::test_cluster_with_header test_s3_cluster/test.py::test_cluster_with_named_collection test_s3_cluster/test.py::test_count test_s3_cluster/test.py::test_count_macro test_s3_cluster/test.py::test_distributed_insert_select_with_replicated test_s3_cluster/test.py::test_distributed_s3_table_engine test_s3_cluster/test.py::test_hive_partitioning test_s3_cluster/test.py::test_parallel_distributed_insert_select_with_schema_inference test_s3_cluster/test.py::test_remote_hedged test_s3_cluster/test.py::test_remote_no_hedged test_s3_cluster/test.py::test_select_all test_s3_cluster/test.py::test_skip_unavailable_shards test_s3_cluster/test.py::test_union_all test_s3_cluster/test.py::test_unset_skip_unavailable_shards test_s3_cluster/test.py::test_wrong_cluster test_send_crash_reports/test.py::test_send_segfault 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case1]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case2]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case3]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case4]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case5]' 'test_send_request_to_leader_replica/test.py::test_alter_table_drop_partition[case6]' test_server_start_and_ip_conversions/test.py::test_restart_success_ipv4 test_server_start_and_ip_conversions/test.py::test_restart_success_ipv6 test_session_log/test.py::test_grpc_session test_session_log/test.py::test_mysql_session -vvv" altinityinfra/integration-tests-runner:cd6390247eca ' returned non-zero exit status 1.